Interactive analysis notebooks on DESY batch resources

نویسندگان

چکیده

Abstract Batch scheduling systems are usually designed to maximise fair resource utilisation and efficiency, but less well for demanding interactive processing, which requires fast access resources while low upstart latency is only of secondary significance high throughput performance computing systems. The clusters at DESY intended as batch end users run massive analysis simulation jobs enabling turnaround systems, in particular when processing expected feed back operation instruments near real-time. continuously increasing popularity Jupyter Notebooks online made an integration this technology into the indispensable. We present here our approach utilise HTCondor SLURM backends integrate Notebook servers techniques involved provide access. chosen offers a smooth user experience allowing customize allocation tailored their computational requirements. In addition, we outline differences between HPC HTC implementations give overview running services.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Metadiscourse Analysis over Interactive VS Interactional Resources within English Academic Articles in Arts and Humanities

In this article, researchers set out to discover the metadiscourse markers in research articles written by both native and non-native English speakers. To this end, a total number of twenty research articles published by Iranian and native English speakers in highly reputed journals on Arts and Humanities domains were randomly selected from major databases including Science Direct, Noormagz, an...

متن کامل

Collecting and Analyzing Provenance on Interactive Notebooks: When IPython Meets noWorkflow

Interactive notebooks help users explore code, run simulations, visualize results, and share them with other people. While these notebooks have been widely adopted in teaching as well as by scientists and data scientists that perform exploratory analyses, their provenance support is limited to the visualization of some intermediate results and code sharing. Once a user arrives at a result, it i...

متن کامل

Interactive Art Analysis Based on Baudrillard’s Hyper reality Theory, a Case Study of Digital Interactive installation

The contemporary philosopher Jean Baudrillard, one of the postmodernism theorists, considers representation in the contemporary world as a factor in the disappearance of reality. In his view, the main feature of new arts is not the expression of artistic beauty, but communication with the audience and expression of the artist’s ideas. In interactive art, the presence and role of the audience in...

متن کامل

Phone notebooks as data on personal networks

This study assesses the nature of data on personal networks derived both from personal paper phone notebooks as well as from the mobile phone electronic notebook. It is illustrated by data on author’s personal network between 1993 and 2000 and in 2002. The text emphasizes the subjective and biographical aspects of this data and suggests that studies based on mobile phone network data may contri...

متن کامل

Evaluation of an Interactive-Batch System Network

a computer network experiment designed to study a method of making the computing power of a high-speed batch system available to the interactive terminal system user. Com-mazds for effecting the intersystem linkage and network operations are presented. Emphasized are system measurements and system tuning techniques for increasing eficiency. There are numerous large computer installations in the...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Computing and software for big science

سال: 2021

ISSN: ['2510-2036', '2510-2044']

DOI: https://doi.org/10.1007/s41781-021-00058-y